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- The MAILING DATE of this communication appears on the cover sheet with the correspondence address - 
Period for Reply 

A SHORTENED STATUTORY PERIOD FOR REPLY IS SET TO EXPIRE 3 MONTH(S) FROM 
THE MAILING DATE OF THIS COMMUNICATION. 

- Extensions of time may be available under the provisions of 37 CFR 1 .136(a). In no event, however, may a reply be timely filed 
after SIX (6) MONTHS from the mailing date of this communication. 

- If the period for reply specified above is less than thirty (30) days, a reply within the statutory minimum of thirty (30) days will be considered timely. 

- If NO period for reply is specified above, the maximum statutory period will apply and will expire SIX (6) MONTHS from the mailing date of this communication. 

- Failure to reply within the set or extended period for reply will, by statute, cause the application to become ABANDONED (35 U.S.C. § 133). 

- Any reply received by the Office later than three months after the mailing date of this communication, even if timely filed, may reduce any 
earned patent term adjustment. See 37 CFR 1.704(b). 

Status 

1 )□ Responsive to communication(s) filed on 4/21/03 . 
2a)Kl This action is FINAL. 2b)Q This action is non-final. 

3) D Since this application is in condition for allowance except for formal matters, prosecution as to the merits is 

closed in accordance with the practice under Ex parte Quayle, 1935 CD. 11, 453 O.G. 213. 
Disposition of Claims 

4) D Claim(s) 28-44 is/are pending in the application. 

4a) Of the above claim(s) is/are withdrawn from consideration. 

5) D Claim(s) is/are allowed. 

6) D Claim(s) 28-44 is/are rejected. 

7) D Claim(s) is/are objected to. 

8) D Claim(s) are subject to restriction and/or election requirement. 

Application Papers 

9) D The specification is objected to by the Examiner. 

10)Q The drawing(s) filed on is/are: a)D accepted or b)Q objected to by the Examiner. 

Applicant may not request that any objection to the drawing(s) be held in abeyance. See 37 CFR 1 .85(a). 
1 1 )□ The proposed drawing correction filed on is: a)D approved b)Q disapproved by the Examiner. 

If approved, corrected drawings are required in reply to this Office action. 

12) D The oath or declaration is objected to by the Examiner. 
Priority under 35 U.S.C. §§119 and 120 

13) ^ Acknowledgment is made of a claim for foreign priority under 35 U.S.C. § 119(a)-(d) or (f). 

a)KlAII b)D Some*c)D None of: 

1 Certified copies of the priority documents have been received. 

2.Q Certified copies of the priority documents have been received in Application No. . 



3.Q Copies of the certified copies of the priority documents have been received in this National Stage 
application from the International Bureau (PCT Rule 17.2(a)). 
* See the attached detailed Office action for a list of the certified copies not received. 

14) D Acknowledgment is made of a claim for domestic priority under 35 U.S.C. § 1 1 9(e) (to a provisional application). 

a) □ The translation of the foreign language provisional application has been received. 

15) D Acknowledgment is made of a claim for domestic priority under 35 U.S.C. §§ 120 and/or 121. 

Attach ment(s) 

1 ) D Notice of References Cited (PTO-892) 4) O Interview Summary (PTO-41 3) Paper No(s). . 

2) Notice of Draftsperson's Patent Drawing Review (PTO-948) 5) d Notice of Informal Patent Application (PTO-152) 

3) □ Information Disclosure Statement(s) (PTO-1449) Paper No(s) . 6) [U Other: 
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DETAILED ACTION 



1 . This action is responsive to communications: Request for reconsideration filed on 
July 15, 2003 to the application, filed on 10/29/1998. 

2. Claims 28-44 are pending in the case. Claims 28, 35, 36, 37 and 43 are 
independent claims. 



3. Receipt is acknowledged of papers submitted under 35 U.S.C. § 1 19, which 
papers have been placed of record in the file. 



4. 35 U.S.C. 101 reads as follows: 

Whoever invents or discovers any new and useful process, machine, 
manufacture, or composition of matter, or any new and useful improvement 
thereof, may obtain a patent therefor, subject to the conditions and requirements 
of this title. 

5. Claims 28-34 remain rejected under 35 U.S.C. § 101 as being directed to non- 
statutory subject matter. 

The claims are not directed to statutory subject matter because the claimed 
subject matter: 

(1 ) does not fall within one of the four statutory classes of inventions under § 
101; and/or ^ 

(2) falls within the mere idea or abstract intellectual concept exception to § 
101; and/or 

(3) falls, by analogy, within the printed matter exception to § 101 . 

The claimed "data structure" is non-functional data structure which is considered 
non-statutory subject matter by analogy to the "printed matter" exception under § 101 . 



Priority 



Claim Rejections - 35 USC § 101 



* 
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See In re Miller 164 USPQ 46, 49 (CCPA 1969). Like printed matter, a data structure, 
in and of itself, is merely an arrangement of data and nothing more. Furthermore, 
claims drawn to printed matter may be non-statutory even though the claims recite the 
structure on which the printed matter is printed: 

The mere arrangement of printed matter on a sheet or sheets of paper, in 
book form or otherwise, does not constitute "any new and useful art, 
machine, manufacture, or composition of matter," or "any new and useful 
improvements thereof," as provided in section 4886, of the Revised 
Statutes [the predecessor to 35 U.S.C. § 101]. 
(emphasis in original). In re Russell . 9 USPQ 181, 182 (CCPA 1931). At best, the 
claims as a whole describe a data structure stored in a computer system. Accordingly, 
like printed matter "stored" on a sheet of paper, a data structure stored in a computer 
system fails to present statutory subject matter. 

The claims recite the limitations directed to describing attributes of the "coded 
presentation", "sub-presentation", etc. These representations are merely the 
descriptions of multimedia data, which are "non functional" data structures . The claims 
do not recite any limitations of "manipulating" the data structures to achieve "practical 
application." Therefore, the claimed recitations of describing these representations are 
merely "non functional" data structures, which are not statutory. Although the sub- 
presentation program segment is embodied on a "computer readable medium", the sub- 
presentation program segment only contains non-functional data structures such as 
"play-out specification", "reference timing", etc. In order to make the claim as a whole 
statutory, the computer readable medium must also contain functional data structures, 
for example, "instructions for playing out the sub-presentation using the playout- 
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specification." Without such functional data structures, the current claims basically 
claim a computer readable medium containing timing data. 

Claim Rejections - 35 (JSC § 102 

6. The following is a quotation of the appropriate paragraphs of 35 U.S.C. § 102 

that form the basis for the rejections under this section made in this Office action: 
A person shall be entitled to a patent unless -- 

(e) the invention was described in a patent granted on an application for patent 
by another filed in the United States before the invention thereof by the applicant 
for patent, or on an international application by another who has fulfilled the 
requirements of paragraphs (1), (2), and (4) of section 371© of this title before 
the invention thereof by the applicant for patent. 

7. Claims 28-32, 34-40 and 42 remain rejected under 35 U.S.C. 102(e) as being 
anticipated by Moorby et al., U.S. Pat. No. 5,892,507, 4/99 (filed on 4/6/95). 

As per Claims 28-32, 34-40 and 42, Moorby teaches the use of a sub- 
presentation which comprises a plurality of sequence of presentation (FIG.1 1a-1 1c), 
wherein the sequence of presentation are presented one after the other, and 
simultaneously with respect to each other (FIG. 12a; col. 12, lines 7-35), wherein the start 
and duration are also specified (col.1 1, lines 45-55, "...the length of a TimeLine track 
and the Icons along it depict the duration..."), and further shows that the interface of the 
sub-presentation provides a time references (see FIG. 12b). 

Moorby further teaches that the sub-presentation provides a sub-presentation 
priority specifying a priority with respect to presenting the subpresentation (FIG.1 shows 
the priority direction of the sub-presentations along the storyline). 
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Claim Rejections - 35 USC § 103 



8. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed 
or described as set forth in section 102 of this title, if the differences between the 
subject matter sought to be patented and the prior art are such that the subject 
matter as a whole would have been obvious at the time the invention was made 
to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was 



This application currently names joint inventors. In considering patentability of 
the claims under 35 U.S.C. 103(a), the examiner presumes that the subject 
matter of the various claims was commonly owned at the time any inventions 
covered therein were made absent any evidence to the contrary. Applicant is 
advised of the obligation under 37 CFR 1 .56 to point out the inventor and 
invention dates of each claim that was not commonly owned at the time a later 
invention was made in order for the examiner to consider the applicability of 35 
U.S.C. 103© and potential 35 U.S.C. 102(f) or (g) prior art under 35 
U.S.C. 103(a). 



9. Claims 33 and 41 remain and 43 and 44 remain rejected under 35 U.S.C. 103(a) 
as being unpatentable over Moorby et al. in view of Gudmundson et al., U.S. Pat. No 
5,680,619, 10/97 (filed 4/95). 



As per dependent claims 33 and 41 , Moorby does not explicitly teach that the 
play-out specification includes a location specification specifying a location of the 
presentation element when presented and wherein interface of the sub-presentation 
provides a location frame of reference relative to which the location specification for the 



made. 
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presentation element is specified. This feature, however, is shown by Gudmundson. 
Like, Moorby, Gudmundson also teaches authoring the multimedia presentation using 
the sub-presentation groups, called "containers"(col.8, lines 25-67). Note that within a 
container includes the sequence of presentations, and also contains the location 
attributes (e.g., FIG. 16(c)) , all of which are interfaced by the container's object interface 
(col. 16, lines 53+). It would have been obvious to a person of ordinary skill in the art at 
the time the invention was made to have incorporated Gudmundson's feature into 
Moorby, since a person of ordinary skill would have appreciated that would have 
provide a user of the Moorby's editor the ability to edit the layout information in addition 
to the timing information. 

As per independent claim 43, Moorby teaches the use of a sub-presentation 
which comprises a plurality of sequence of presentation (FIG.1 1a-1 1c), wherein the 
sequence of presentation are presented one after the other, and simultaneously with 
respect to each other (FIG. 12a; col. 12, lines 7-35), wherein the start and duration are 
also specified (col.1 1 , lines 45-55, "...the length of a TimeLine track and the Icons along 
it depict the duration..."), and further shows that the interface of the sub-presentation 
provides a time references (see FIG. 12b). Moorby further teaches that step of 
accessing a medium, readable by the device and on which the coded multi-media 
presentation is stored (col.2, lines 34-36, showing the Windows-based computer 
implementation). 

However, Moorby does not appear to explicitly teach the use of a self-contained, 
sub-presentation data structures, and using the structure for retrieving at least one play- 
out specification portion from a first location in the data structure, which play-out 
specification portion specifies timing behavior of at least one respective presentation 
element within the data structure; and responsive to the play-out specification, retrieving 
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the at least one respective presentation element from a second location in the data 
structure. In other words, Moorby's presentation elements provide the playout 
specification including the timing information, but Moorby does not appear to disclose 
that the playout specification and the playout elements are necessarily encapsulated in 
a self-contained data structure. Nevertheless, the use of the self-contained data 
structure for storing and accessing the presentation elements are well known as 
evidenced by Gudmundson. Like, Moorby, Gudmundson also teaches authoring the 
multimedia presentation using the sub-presentation groups, called "containers"(col.8, 
lines 25-67). Note that within a container includes the sequence of presentations, and 
also contains the location attributes (e.g., FIG. 16(c)) , all of which are interfaced by the 
container's object interface (col. 16, lines 53+). Therefore, Gudmundson's object 
container (col. 8, line 28) discloses the use of the self-contained data structures. It would 
have been obvious to a person of ordinary skill in the art at the time the invention was 
made to have incorporated Gudmundson's feature into Moorby, since a person of 
ordinary skill would have appreciated that would have provide a user of the Moorby's 
editor the ability to edit the layout information in addition to the timing information. 

As per dependent claim 43, which depends on claim 42, Moorby in view of 
Gudmundson discloses that the sub-sub-presentation data structure comprising at least 
one play-out specification sub-sub-structure and a plurality of presentation element sub- 
sub-structures, since Gudmundson teaches that the "Hierarchical Encapsulation" (col. 8, 
line 27) is being used for the object containers storing the multimedia playout data. 
Therefore, Gudmundson teaches the use of sub-sub data structures under the hierarchy 
of the sub-data structures for the multimedia presentation. 
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Response to Arguments 



10. Applicant's arguments filed September 22, 2003 have been fully considered but 
they are not persuasive. 

On pages 4 and 5 Applicant presents the following arguments: 

Independent claim 28 recites a presentation program portion stored on a 
computer readable medium. The portion includes a segment that includes a 
presentation element. A presentation element is defined at page 6, lines 8-9 of 
the specification, "A presentation element is part of the presentation, link a still 
image or piece of text, which at any given moment is presented in the 
presentation." [emphasis added] In other words, the actual content, i.e. the 
presentation elements, is included in the segment. 

The Examiner has pointed to figures 1 1 a-c and figures 12 a-b of Moorby, 
along with columns 1 1 and 12 of the same document. The text and figures 
pointed to by the Examiner are TimeLines. These timelines do not actually store 
the parts of the program. Instead, they are used to "determine the length of play 
of each or selected of the icons which are represented in the StoryLine." In other 
words, the graphical data illustrated in these pictures controls the presentation of 
program portions that are stored elsewhere. The rectangular boxes 256-266 are 
only icons, not actual presentation elements. The Examiner has therefore failed 
to indicate where in the reference any presentation program portions are actually 
stored in a computer readable medium. 

Claim 28 further recites that the reference timing is defined independent of 
the presentation elements. In the TimeLines of Moorby, the length of the 
presentation element is determined by the physical length of the icons 256-266. 
Therefore, even if the Examiner thinks that these icons are presentation 
elements (which they are not) the timing is not stored independent of them. They 
determine the timing by their own lengths, i.e. by one of their own non- 
independent parts. Accordingly, these TimeLines fail to teach of suggest storing 
the reference timing independently of the presentation elements within a sub- 
presentation program segment. 

Examiner disagrees with the arguments. Applicant somehow appears to be 
making the argument as if the graphical displays of Moorby must be able to store the 
data on the graphic itself. It seems that the Applicant does not quite understand the 
relationship of displays with respect to the data stored in a computer. Firstly, Applicant 
should recognize that whatever displayed on the screen is not the whole data - rather, it 
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is a visual representation of the data. For example, just because a letter "A" is displayed 
on screen, that does not just mean that the computer storage has only "A" stored. If fact, 
what is stored can be a complex equation dictating how "A" needs to be drawn on the 
display. Now, Applicant continues to make the argument that the icons (for example), 
showing the playout relationship in Moorby, are not the actual "image" to be displayed 
during the playout. Examiner is not arguing that. However, Applicant is misconstruing 
the Moorby reference by saying that the "icons" are the only things that are stored in the 
computer of Moorby. Rather, Moorby's storage contains both the actual playout data 
along with the playout specification (col. 2, line 2, "customize the story's content and 
structure"). The icons just happen to be a visual indication of the stored data. Since the 
Moorby's storage contains both the playout data and the playout specification indicating 
how the presentation element is to be played", the claimed limitations are clearly met. 
Furthermore, "indicating how the presentation element is to by played" does not at all 
have to be a complex relationship. In fact, a color image containing the specification of 
the indication of the colors of its image is an "indication of how the presentation element 
is to be played." Even further, there is no clearly claimed boundary as to what the 
"playout element" cannot have. That is, any set of program segments of data that 
contains both the playout media and an indication of how the media is to be presented 
can be a playout element. When a specific structure is claimed, Examiner will address 
the structure. For example, Applicant should refer to the rejection of Claim 43, when a 
specific structure of the playout element was claimed, Examiner specifically addressed 
the claimed limitation. 

On pages 2 and 3 of the argument, with respect to the rejection under 35 USC 
101 , Applicant asserts that Applicant suggests that Applicant's claim 23 is should be 
similarly statutory as "In Re Lowry, 32 USPQ2d 1031 (Fed. Cir. 1994), which made 
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clear that data structures of the sort claimed here are patentable subject matter under 
35 USC 101." However, examiner disagrees. Lowry's data structures were deemed 
functional as it provided specific structures of the interrelationship among memory that 
would in fact direct the computer execution in the specific way. What Applicant is 
claiming in claim 28 is the content of data, where the data happens to have some 
indication of what can be done with the data. There is not specific interrelationships 
among data structures in memory to embark a statutory function. Again, by analogy, the 
play out specification is no different that, for example, the musical notes store on a 
medium. It has "functionality" meaning that it has usage, but the notes themselves do 
not perform any function by providing the specific data structures. Similarly, the play out 
specification merely contains data that is to be used, just like any data stored in a 
computer storage. Therefore, it is clearly a non-functional data structure. 

Conclusion 

1 1 . THIS ACTION IS MADE FINAL. Applicant is reminded of the extension of time 
policy as set forth in 37 CFR 1.136(a). 

A shortened statutory period for reply to this final action is set to expire THREE 
MONTHS from the mailing date of this action. In the event a first reply is filed within 
TWO MONTHS of the mailing date of this final action and the advisory action is not 
mailed until after the end of the THREE-MONTH shortened statutory period, then the 
shortened statutory period will expire on the date the advisory action is mailed, and any 
extension fee pursuant to 37 CFR 1 .1 36(a) will be calculated from the mailing date of 




it 
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the advisory action. In no event, however, will the statutory period for reply expire later 
than SIX MONTHS from the mailing date of this final action. 



12. Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Steve Hong whose telephone number is (703) 
308-5465. The examiner can normally be reached on Monday-Friday from 8:00 AM- 
5:30 PM. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Heather Herndon, can be reached on (703) 308-5186. 

Any inquiry of a general nature or relating to the status of this application should 
be directed to the Group receptionist whose telephone number is (703) 305-3900. 

Any response to this action should be mailed to: 



Commissioner of Patents and Trademarks 
Washington, D.C. 20231 
or faxed to: 

(703) 308-9051 , (for formal communications intended for entry) 

Or: 

(703) 305-9724 (for informal or draft communications, please label 

"PROPOSED" or "DRAFT") 
Hand-delivered responses should be brought to Crystal Park II, 2121 
Crystal Drive, Arlington. VA., Sixth Floor (Receptionist). 




Primary Examiner 



September 21, 2003 



